Measuring the Impact of Conversational Technology Interventions on Adolescent Wellbeing: Quantitative and Qualitative Approaches

In order to help adolescents cope with loneliness during the social distancing and isolation imposed by the COVID-19 pandemic, we designed a conversational agent programmed to distract users from negative thoughts and advise them on strategies to improve their wellbeing. In order to assess the effects of the agent intervention on adolescent participants, we performed quantitative analysis of their self-reported mood states and qualitative analysis of their subjective views and opinions on the agent to help us understand their experiences. Trends in the quantitative data point to minimal changes in participants' wellbeing and loneliness after interactions with the experimental agent. However, qualitative data on adolescent experiences suggests short and long-term positive effects of the experimental interactions. In reporting our findings, we aim to bring attention to the importance of the qualitative data for understanding human experiences with technology, as well as the limitations of the instruments developed in the field of psychology for human-information interaction research. 85th Annual Meeting of the Association for Information Science & Technology ;Oct. 29 – Nov. 1, 2022 ;Pittsburgh, PA. Author(s) retain copyright, but ASIS&T receives an exclusive publication license.

Talk it Out: Teen Reactions to a Supportive Conversational Agent

COVID-19 measures of isolation exacerbated the negative feeling, particularly in younger and older populations. We tested a voice conversational agent designed to support teens by offering interactions based on five types of behavioral interventions (compassion, self-compassion, positive psychology, mindfulness, and humor), and examined teen reactions to these interventions. Thirty-nine adolescents were asked to assess one randomized interaction a day for fifteen days. All five intervention types received positive ratings, with self-compassion scoring the highest and compassion scoring the lowest by the participants. Participants shared more positive than negative feedback about the interaction scenarios, the perceived agent’s personality and conversational flow. Positive feedback emphasized enjoyment and benefits of the interaction, empathetic traits in the agent’s responses, a sense of validation, and moments for self-reflection fostered by the interactions. Participants enjoyed the conversation flow that felt similar to a natural conversation. Negative comments generally revolved around perception of the impersonal agent, inappropriate pace of conversation (too slow/fast) or number of conversational turns, and dislike of some interaction topics. Recommendations based on this exploratory work are included. 85th Annual Meeting of the Association for Information Science & Technology ;Oct. 29 – Nov. 1, 2022 ;Pittsburgh, PA. Author(s) retain copyright, but ASIS&T receives an exclusive publication license.

The kids are alright: adolescents' experiences during COVID-19 disruption

Purpose - This study aimed to understand adolescents experiences, negative feelings and coping mechanisms associated with the major disruption caused by the COVID-19 pandemic. The purpose of this study was to develop a baseline for understanding adolescents and their environment to assist future developments of technological and other solutions to mitigate adolescents' loneliness, improve their wellbeing and strengthen their resilience. Design/methodology/approach - The data about adolescents' experiences during the COVID-19 pandemic was collected through virtual interviews conducted via Zoom. A total of 39 adolescents (aged 12 through 18 years) primarily from the North East of the USA participated in the study. The transcripts of the interviews were analyzed using thematic analysis. Findings -This study found evidence of negative disruptions to adolescents' social, learning and emotional routines. This study also found that in dealing with the effects of COVID-19 disruption, most of the participants exhibited five key attributes of individual resilience, including social competence, problem-solving, critical consciousness, autonomy and a sense of purpose. External factors supporting resilience were also mentioned, including technology resources, family, school and broader community. Originality/value - This study relied on fast-hand adolescents' reports of their experiences, feelings and coping strategies during the pandemic. This study applied a resilience framework to interpret the findings and translate them into recommendations for further development of support systems for adolescents.